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1  Introduction 


If  the  random  variables  . . .  ,xp  follow  the  multivariate  normal  (MVN)  dis¬ 
tribution  with  means  zero,  common  variance  a2,  and  a  correlation  matrix 
H  —  [/9j;],  and  if  (vs2) /a2  is  an  independent  \2  variable  with  v  degrees  of  free¬ 
dom,  then  the  random  vector  t  =  , «» ,,  fp),  where  £,■  =  xjs  (for  i  =  1, . . .  ,p) 

is  said  to  have  the  p-variate  ^-distribution  with  v  degrees  of  freedom.  This 
distribution  is  the  multivariate  analogue  of  Student’s  t  with  density  function: 


/(<!, 


r(2^)|f7-1|1/2 

(l/7T)P/2  I>/2) 


(i  + 


(i) 


The  distribution  has  applications  in  a  number  of  statistical  problems,  most 
notably  in  the  multiple  comparison  of  several  treatments  with  a  control  (Dun- 
nett,  1955),  and  as  John  (1961)  has  noted,  in  the  construction  of  simultaneous 
confidence  bounds  for  the  parameters  in  a  linear  model.  We  will  discuss  these 
applications  of  the  multivariate-t  distribution  and  suggest  a  numerical  method 
for  evaluating  the  probabilities  associated  with  this  distribution. 


2  Dunnett’s  Test 


Consider  the  problem  of  comparing  each  of  p  treatments  with  a  control  in 
respect  to  their  means  po,pi .p2,...,pp,  where  po  designates  the  control  and 
x,,  i  =  1,2 —  ,p,  the  treatments.  Assume  that  the  observations  are  normally 
and  independently  distributed  with  common  within-group  standard  deviation 
cr.  In  this  case,  Dunnett  (1955)  has  provided  a  procedure  for  making  confi¬ 
dence  statements  about  the  p  differences  p,  -  p0,  such  that  the  probability  of 
all  p  statements  being  simultaneously  correct  is  equal  to  a  specified  P  level. 
Dunnett's  procedure  and  the  associated  tables  are  available  for  the  case  of 
equal  sample  sizes  in  all  groups.  Here,  we  will  expand  the  procedure  to  the 
case  where  the  sample  sizes  are  not  equal,  and  to  an  even  more  general  class 
of  problems  involving  simultaneous  statistical  inference. 

Suppose  that  there  are  n0  observations  for  the  control.  ri\  observations  for 
the  first  treatment,  ...  ,  np  observations  for  the  p-th  treatment,  and  denote 
these  observations  by  .Y„  (ij=  0. 1 . p;  j  =  1.2 . n.)  and  the  correspond¬ 

ing  i-th  treatment  mean  as  .V,.  Assume  that  there  is  an  estimate  of  cr2  available 
(denoted  s2)  based  on  v  degrees  of  freedom,  which  is  independent  of  the  esti¬ 
mator  of  the  mean.  Now  let 


.Y,  -  .Y0  -  (p,  -  p0) 


np+n, 

non, 


C2) 


o 


and  let  U  =  Zi/s  for  i  -  1  ,2,...,p.  As  Dunnett  (1955)  notes,  the  lower 
confidence  limits  with  joint  confidence  coefficient  P  for  ♦he  p  treatment  effects 
fH  -  no  are  given  by 


if  the  p  constants  d ,  are  chosen  so  that 

Prob(ft  <  dv.t2  <d2 . tp  <dp)  =  P.  (4) 

To  find  the  p  constants  dt  that  satisfy  these  equations,  the  joint  distribu¬ 
tion  of  the  f,  is  required,  which  is  the  multivariate  analogue  of  Student's  t- 
distribution  defined  by  Dunnett  and  Sobel  (1955).  Dunnett  (1955)  has  shown 
how  the  problem  of  evaluating  the  multivariate  f-distribution  can  be  reduced 
to  the  problem  of  evaluating  the  corresponding  MVN  distribution.  For  the 
latter,  notice  that  the  joint  distribution  of  the  r,  is  a  MVN  distribution  with 
means  0  and  variances  a2.  The  correlation  between  r,  and  z}  is  given  by: 

Pi:  =  1/ 

which  for  the  special  case  of  equal  sample  sizes  equals  1/2  for  all  i  and  j. 
Dunnett  and  Sobel  note  that  the  joint  probability  statement  given  above  can 
be  written  in  the  following  way: 


=  Prob {tl<dl.t2<d2 . tp  <  dp) 

=  Prob(ci  <  dis,  z2  <  d2s . zp  <  dps) 

/+oo 

F(d\$,d2s . dps)  f{s)ds . 

-•X 


where  F{di$.d2$ . dps)  is  the  MVN  cdf  of  the  c,  and  f(s)  is  the  one¬ 

dimensional  density  function  of  s.  Thus,  with  probability  values  for  F(-).  the 
above  equation  can  be  evaluated  using  numerical  integration  over  the  distribu¬ 
tion  of  s.  For  this,  note  that  the  density  function  of  s  is  given  by  Pearson  and 
Hartley  (1976)  as: 


f(s)  = 


r(K)2<*,/2>-1 


-[/  v-i 


exp{-vs7/2o-2). 


Since  s2/a2  =  \2/ v  we  can  rewrite  the  equation  for  P  in  terms  of  integration 
over  the  distribution  of  u  =  s/cr  (which  is  defined  on  0  to  +oc)  as: 


/+00  ,  as 

P  ~  Jo  ^^lU’^2U . dpu) f(u)fadu 

r+ oo  y*'/2  ,  ,, 

=  jf  F(dxuJ2u . dvu )  -—-—uv-1&kq(-vu  12)  du.  (8) 

Numerical  integration  over  the  distribution  of  c  can  then  be  performed  to  yield 
the  associated  probability  P  for  selected  values  of  d,  p,  and  u. 


3  Some  Special  Cases 

Direct  evaluation  of  the  MVN  cdf  is  not  possible  for  p  >  3.  In  the  following, 
we  note  some  special  cases  for  which  reduction  formulae  are  available. 

3.1  Case  1:  nQ  =  n,-  =  n.  (i  =  1 . p) 

When  all  sample  sizes  are  equal,  the  correlation  in  (5)  is  1/2  for  all  possible 
pairings  of  the  treatment  groups  and  the  control.  Dunnett  (1955)  has  given 
tables  for  the  critical  values  of  this  distribution.  In  this  case,  the  MVN  prob¬ 
ability  in  (S)  is  simply 

F„(0.0 . 0:(5|)  =  -^y-  (9) 

3.2  Case  2:  nQ  =  n  and  n,-  =  m.  (i  =  1 . p ) 

When  the  p  treatment  groups  are  each  of  size  m,  but  the  control  group  is  of 
size  n.  where  n  ^  m,  then  from  (5).  pt]  =  p  for  all  i,j.  and  the  the  probability 
in  (8)  is 


Fp(ds.  ds 


f(y)d{y) , 


(10) 


where  f(t)  =  exp(-  ji2 )/(2tt )1/2  and  F(t)  =  J^f(t)dt.  see  Gupta  (1963). 


3.3  Case  3:  no  =  n  and  nx  unequal 

When  the  treatment  group  sample  sizes  are  unequal,  the  correlation  matrix 
{/>«;}  has  the  special  foim 
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Pi)  ~  OtiQj 


for  ( i  ^  j).  where  -1  <  a,-  <  +1.  In  this  case,  the  MVN  cdf  is: 


(see  Dunnett  and  Sobel,  1955).  This  MVN  integral  can  be  approximated  to 
any  practical  degree  of  accuracy  using  Gauss-Hermite  qaudrature  (Stroud  and 
Sechrest,  1966). 

4  The  General  Case 

The  special  cases  in  the  previous  sections  provide  methods  for  evaluating 
the  MVN  integral  in  (S).  that  cover  all  possible  applications  of  the  Dunnett 
type  multiple  comparison  with  control  procedure,  regardless  of  the  sample 
sizes  of  the  various  groups.  Nevertheless,  there  are  still  situations  in  which 
a  completely  general  solution  is  required.  Of  course,  for  the  general  case,  a 
more  general  method  for  evaluating  the  probabilities  of  the  MVN  cdf  F(-) 
is  needed.  For  example,  in  regression  analysis  the  (61.62. ...,  bp)  are  MVN 

with  means  (Ji,  . Jp)  and  variance  covariance  matrix  {ctJ}<72  =  S~la 2. 

where  S,}  =  £;!.,(£,>  -  x,)(.r;r  -  j;)  for  (i.j  =  1.2 . p).  In  this  case. 

{ P, ;}  =  (c„c;j)-V2c,;  and  none  of  the  previous  reduction  formulae  apply.  One 
computationally  tractable  possibility  is  to  use  Clark's  (1961)  formulae  for  the 
moments  of  the  maximum  of  p  correlated  normal  variables  as  applied  by  Gib¬ 
bons  et.  ai.  (1987)  to  the  problem  of  approximating  MVN  orthant  probabil¬ 
ities.  A  brief  description  of  this  approximation  is  now  provided,  and  we  will 
show  that  these  probabilities  are  sufficiently  accurate  for  practical  purposes. 

4.1  The  Clark  Algorithm 

We  begin  by  noting  that  the  MVN  cdf  Fp{di$.d2s . dps\  {p.^})  can  be  written 

as:  ' 

Fp  =  Pr(x{  <  h{.x2  <  h2....xn  <  hn),  (12) 
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where  hx  —  di$.  If  hx . . .  kn  =  k  —  0,  and  the  x,  follow  a  standardized  MVN 
distribution,  F%  is  a  so-calie.'  “orthant”  probability.  However,  note  that  we 
can  also  write  this  MVN  probability  as: 

=  Pr{max(Xi . £„)<0}.  (13) 

If  max(x i . xn)  were  normally  distributed,  which  it  clearly  is  not.  with  mean 

£(max(j„  . . . ,  ,)]  and  variance  l'[max(£, . £„)],  then, 


F°P  =  F 


E(max(xi . xn)  —  h 

yJV(max(x\ . xn) 


(14) 


where  in  this  case  h  =  0.  For  general  ht,  we  would  set  h  =  0  and  subtract  ht 
from  the  mean  of  x,. 

In  order  to  proceed,  we  need  the  first  two  moments  of  ma. r(x, . xn )  where 

the  x,  have  a  joint  MVN  distribution  with  general  correlation  {/>,.,},  and  some 
bound  on  the  error  introduced  by  assuming  that  max(x,, . . .  xn)  has  a  normal 
distribution.  Clark  (1961).  has  provided  an  approximation  for  the  first  four 
moments  of  the  maximum  of  p  jointly  normal  correlated  random  variables,  and 
Gibbons  et.  al..  (1990),  have  shown  that  the  accuracy  of  the  approximation  is 
approximately  10"3  in  problems  of  this  kind.  An  overview  of  the  approximation 
is  provided  in  the  following. 

Let  any  three  successive  components  from  an  p- variate  vector,  y,,  be  dis¬ 
tributed: 


’  y, 

~  X 

f 

’  Pi 

*?  ,  1 

y.+i 

P<+i 

• 

&i  ^i  +  l  Pi. i  +  l  ^i  +  l 

.  i/«+ 2  . 

\ 

.  Hi+2  . 

.  &i+2  Pi.i+2  ^i+l  &i+2  Pi+l.i+2  ^+2. 

/ 

Let  y,  =  ma x(y,)  =  y,.  and  compute  the  probability  that  y,+ j  >  y,  as 
follows: 

S®t  '■i  +  l  =  (pi  —  Pt  +  \  )/Ci  +  l  • 

where  C,+i  =  +  ^+i  -  2cr,  cr1+l 

Then  P(y,+\  >  y)  =  P(y,+i  -  y  >  0) 


the  value  of  the  univariate  norma!  distribution  function  at  the  standard  deviate 
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Now  let  y,+l  =  max(y,,yl+i)  and  assume  (as  an  approximation)  that  (y,+2,yl+i) 
is  bivariate  normal  with  means, 

=  £(yi+ 2)  =  m+2 

^(y«+i)  =  £(y>+i)  =  -,+i)  +  4‘,+l0(5j+1), 

variances 

tf2(i/i+2)  =  =  <x,2+2. 

^2(y.+i)  =  £(£,+,)  -  £2(yt+i).  (16) 

where 


^<+i)  ~  +^)^(-.+i)  +  (^,2+i  +‘?,+i)<fr(-*,+i )  +  (/*,  +^+iK,+i0(s<+i), 

(17) 

and  correlation 

^(</.+  l)  '  ^ 

Then, 


P(yi+2  =  max(y„yl+l.yl+2))  =  P((y1+2  -  y1+1  >  0)  n  (yi+2  -  y,  >  0))  (19) 

is  approximated  by 


P(y<+2>yl+i)  =  P(y,+2  -  y,+i  >  0) 

_  $  |  /b+2-/‘(y»+i)  \ 

Wa«+*  +  <r2(y1+i)  -  '2al+2<r(yi+1)/5(yt+l,i/,+2)j 

(20) 

Assuming  as  a  working  approximation  that  yl+1  is  normally  distributed 
with  the  above  mean  and  variance,  we  may  therefore  proceed,  recursively  from 
i  =  1  to  i  —  p  -  1.  where  yp+l  is  an  independent  dummy  variate  with  mean 
zero  and  variance  zero  (i.e.  yp+1  =  0).  Then,  for  example'. 

P{yp+i  =  max(yv,y2,..,,yp+1)i 

=  P  [{yP+ 1  -Vi  >  0)  n  (yp+1  -  y2  >  0)  n . . .  n  (yp+1  -  yp  >  0)] 

=  P [(— yi  >  0) n (-y2  >  o) n . . . n  (-yp  >  o)]  C2i) 


I 


approximates  the  negative  orthant.  The  probability  of  any  other  orthant  can 
be  obtained  by  reversing  the  signs  of  the  variates  corresponding  to  l’s  in  the 
orthant  pattern. 

More  generally,  to  compute  any  MVN  orthant  probability,  for  example. 

/  /  ■•■/  f(xl.x2,...,xp:{ptJ})dxl...dxp  (22) 

J  J -oc  J -<x. 

we  compute  the  negative  orthant  setting  ;*p+i  =  h.  Finally,  to  approximate  the 
integral  for  general  h„  we  compute  the  negative  orthant  by  setting  /ip+l  =  0 
and  p,  =  /i,  -  kt.  In  the  present  context  A,  =  d,s 

4.2  Applications 

To  illustrate  the  use  of  the  general  approximation,  consider  the  following  two 
multivariate  prediction  problems. 

4.2.1  Confidence  Bounds  for  Means 

Simultaneous  confidence  bounds  for  the  means  of  correlated  normal  variables 

can  now  be  found  using  the  general  method.  Suppose  xj . xp  are  MVN 

with  mean  vector  /< i . /xp  and  dispersion  matrix  a2{ptj},  where  {ptJ}  is  the 

correlation  matrix.  The  Clark  algorithm  can  be  used  to  satisfy  the  inequality, 

x,  -  \'~%d$  <  /t,  <  x,  +  \'~>d$  (23) 

for  (t  =  1 . p). 

4.2.2  Confidence  Bounds  for  a  Future  Observation 

Similarly,  simultaneous  confidence  bounds  for  a  future  p-variate  observation 
may  also  be  found  in  this  way.  Suppose  xj . xp  represent  a  future  observa¬ 

tion  vector  from  a  MVN  population  with  equal  variances  and  correlation  matrix 
{ptJ}.  A  previous  sample  of  size  N  is  available  from  which  the  estimates  x  and 
s  are  obtained.  The  Clark  algorithm  can  be  used  to  satisfy  the  inequality. 

x,  -  (1  +  1  /.X)~'>d$  <  x,  <  x,  +  (1  +  1  /N)~?d$  (24) 

for  (i  =  1 . p).  The  value  h  =  ds  is  selected,  such  that  the  desired  confidence 

level  P  in  (6)  is  obtained. 


Table  1 

95%  Critical  Values  for  Various  Modifications  of  Dunnett’s  Test 


Case 

n0 

n2 

"3 

n4 

/ 

( Pi j  =  P  =  -5) 

II 

(Pit  =  P) 

HI 

(Pi)  -QtOj) 

IV 

iPb) 

1 

10 

10 

10 

10 

10 

2.22 

2.22 

2.22 

2.20 

1 

20 

20 

20 

20 

20 

2.19 

2.19 

2.19 

2.17 

2 

10 

20 

20 

20 

20 

2.19 

2.13 

2.13 

2.12 

2 

10 

30 

30 

30 

30 

2.  IS 

2.09 

2.09 

2.07 

2 

20 

10 

10 

10 

10 

2.20 

2.25 

2.25 

2.22 

3 

10 

30 

50 

20 

10 

2.19 

2.10 

2.11 

2.10 

3 

10 

5 

50 

10 

50 

2.  IS 

2.09 

2.13 

2.13 

I  Dunnett’s  original  test  (correct  for  case  1  only) 

II  r?0  controls  and  m  =  n{  =.•••.=  nA  treatments  (correct  for  cases  1  &  2) 

III  All  n,  potentially  different  (1  dimensional  quadrature;  correct  for  cases  1.2,3) 

IV  General  {p,j}  (Clark  approximate  for  all  cases) 


5  Illustrations 

Table  1  presents  comparisons  of  various  modifications  of  Dunnett’s  test  for 
various  sample  size  combinations  for  a  5  group  study. 

Inspection  of  Table  1  reveals  that  all  three  of  the  reduction  formulae  work 
exactly  as  anticipated.  The  general  solution  based  on  the  Clark  approximation 
performs  quite  well,  and  if  anything,  it's  accuracy  is  best  in  those  cases  when 
it  is  most  needed,  it..  when  the  correlations  are  heterogeneous.  Dunnett’s 
original  tabled  values  {it.,  case  I),  appear  to  overestimate,  the  true  values 
when  n0  <  n,  and  underestimate  the  true  values  when  n0  <  n,.  In  general,  the 
case  II  solution  (i.t.,  {pl}}  =  p)  works  reasonably  well  under  all  conditions; 
however,  it  is  somewhat  biased  in  the  final  example  in  which  the  sample  sizes 
are  quite  variable. 

As  a  second  numerical  example,  let  us  return  to  the  problem  of  obtain¬ 
ing  simultaneous  confidence  bounds  for  regression  coefficients.  Mosteller  and 
Tukey  (1977,  pages  549-551)  recovered  demographic  transition  data  on  fertility 
rates  and  five  socioeconomic  indicators  from  47  Swiss  provinces  in  18S8.  The 
socioeconomic  indicators  were; 

1.  Proportion  of  population  involved  in  agriculture  as  an  occupation. 

2.  Proportion  of  draftees  receiving  highest  mark  on  army  examination. 
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3.  Proportion  of  population  whose  education  is  beyond  primary  school. 

4.  Proportion  of  the  population  who  are  catholic. 

5.  Infant  mortality:  proportion  of  live  births  who  live  less  than  I  year. 

The  common  standardized  fertility  measure  It  was  used  as  the  dependent 
measure  and  the  socioeconomic  indicators  xj, . . . ,  x5  were  the  predictors.  The 
least  squares  estimated  regression  equation  was: 

/g  =  .645  -  .'203xi  -  .295 x^  -  .896x3  -f  .001x4  +  1.316x5 

This  regression  equation  reveals  that  fertility  is  inversely  related  to  socioe¬ 
conomic  status,  which  is  consistent  with  the  fact  that  at  the  time,  fertil¬ 
ity  was  beginning  to  fall  from  the  high  level  generally  found  in  underdevel¬ 
oped  countries  to  the  lower  level  that  it  has  today.  The  correlation  matrix 
{Pi)}  =  (Ci,Cjj)~inc,j  of  the  ( 6t . — 6S)  was: 

'  1.00 
.21  1.00 

{p,j}  =  .39  -.59  1.00 

—  .26  .55  -.47  1.00 

.17  -.03  .15  -.17  1.00 

and  the  unbiased  moment  estimator  sJ  of  a2, 

=  y  _  ^  (Tyy  -  b\Tyl  ~  k^T y2  ~  ■■■  ~  ^ Ty$ )  (25) 

where 

.v 

r»«  =  *tk -■?.)  (i  =  1.2 . p)  (26) 

b=l 

and 

.v 

Tyy  =  '£(y,-y)2  (27) 

fc=l 

was  s2  =  .0045.  The  elements  c„.i  =  1.2, _ p  of  S~l  were  cu  =  .96, 

C22  =  11.89,  C33  =  6.55.  C.H  =  .000024,  and  C55  =  30.58.  Using  the  general 
approximation,  we  find  that  the  inequalities 

b,  -  dels  <  3,  <  b,  +  dels  (i  =  1,2 . p)  (28) 

are  simultaneously  satisfied  for  P  =  .95  when  d  =  2.32,  which'  yields  the 
confidence  limits: 
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-.36 

< 

A 

< 

-.051 

-.83 

< 

d2 

< 

.24 

-1.29 

< 

A 

< 

-.50 

.00024 

< 

A 

< 

.0018 

.46 

< 

A 

< 

2.18 

The  confidence  limit  for  62  (he.,  proportion  of  draftees  receiving  highest  marks 
on  army  examination),  was  the  only  interval  that  included  3  =  0.  For  a  single 
interval  d  =  <-u.05  =  2.02.  which  is  considerably  smaller  than  the  simultaneous 
value  of  d  =  2.32  used  here.  Had  we  used  a  simple  Bonferroni  type  adjustment 
(i.e.,  a  =  .05/5  =  .01).  then  d  =  ^i..oi  =  2.70,  which  would  clearly  have  been 
overly  conservative. 

6  Summary 

In  this  paper  we  have  provided  methods  for  evaluating  the  multivariate  t- 
distribution  with  and  without  restrictions  on  the  form  of  the  correlation  matrix 
{p,;}.  Using  these  results.  Dunnett's  test  for  multiple  treatments  compared  to 
a  single  control  was  then  generalized  to  various  unbalanced  cases.  In  the  more 
general  case,  in  which  {p,;}  does  not  have  a  simple  unidimensional  form,  we 
have  applied  Clark's  approximation  to  the  moments  of  the  maximum  of  n  cor¬ 
related  random  normal  variables  to  the  problem  of  approximating  the  required 
MVN  cdf.  This  approach  appears  to  work  well,  and  is  the  only  computation¬ 
ally  tractable  solution  for  the  case  of  general  {/>,;}.  Application  to  the  problem 
of  obtaining  simultaneous  confidence  limits  for  regression  coefficients,  clearly 
illustrates  the  importance  of  this  approach,  given  that  repeated  use  of  limits 
designed  for  a  single  comparison  yield  inadequate  coverage,  and  simplistic  ad¬ 
justments  that  do  not  take  the  correlational  structure  into  consideration.  ( e.g .. 
Bonferroni  adjusted  a‘  =  a/p),  yield  limits  that  are  overly  conservative. 
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Dr.  Gary  Marco 
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Educational  Taatinp  Same* 
Pnncatoa  NJ  0(451 

Dr.  Omani  J.  Martin 
Office  of  Quaf  of  Naval 
Open  none  (OP  13  F) 

Sivy  Anna.  Room  2(32 
Washington  DC  200)0 

Dr.  Jem**  R.  McBnda 
Tb*  Psvcboiopcal  Corporation 
1250  Scab  Avenue 
San  Diago.  CA  42101 

Dr.  ClaronroC.  McCormick 
HO.  USMEPCOM/MEPCT 
2500  Groan  Bay  Road 
Nonh  Oik*  go.  'L  40044 

Mr.  Chnatophar  McCuakar 
Umvamty  of  lllino* 
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eO)  &  Daniel  Sc 
Champaign  IL  41(20 
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Educational  Tcauif  Same* 
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Dr.  Wigum  Montagu* 

NPRDC  Cod  15 
Sm  Diego.  CA  92152-4(00 

Mi.  Kathleen  Monno 
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Son  Diego.  CA  92152-4100 
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Educational  Studies 
W.ltard  Hall.  Rood  215E 
Uwvetsuy  of  Dataware 
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Dr.  Harold  F  ONed.  Jr 
School  of  Education  -  WPK  801 
Depenment  of  Educauonai 
Peychotogr  A  Techndogy 
University  of  Southern  California 
Loa  An  idea.  CA  40099-0031 

Dr  Jama*  3.  Olaen 
WICAT  Systems 
1(75  South  Si  -  Street 
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Dr.  Judith  Oraaanu 
Beaic  Reaearch  Office 
Amy  Reaearch  Inaututc 
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Alemndna.  VA  22555 

Dr.  Jaaae  Ortantky 
lnautute  for  Defena*  Analyses 
1801  N.  Beaureprd  St. 
Alemndna.  VA  22311 

Dr.  Peter  J.  Paahlcy 
Educational  Tatung  Service 
Roeedale  Road 
Princeton.  NJ  0(541 

Wayne  M.  Patience 
American  Courted  on  Education 
GED  Taaun|  Seme*.  Sun*  20 
On*  Dupont  Grek.  .VW 
Washington.  DC  20054 

Dr  Jama  Paulaon 
Department  of  Psychology 
Portland  State  Unnemty 
PO.  Boa  751 
Portland,  OR  97207 

Dr  Mart  D  Reduce 
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P.  O.  Boa  14A 
Iowa  City.  IA  52245 

Dr.  Malcolm  Re* 
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Dr.  Carl  Row 
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Greet  Ukaa  NTC  'L  eOOM 
Dr.  J.  Ryan 

Department  of  Education 
University  of  South  Carolina 
Columbia.  SC  29200 

Dr.  Fumtko  Samejiau 
Department  of  Psychologr 
University  of  Tennaeaee 
3106  Auebn  Feay  Bldg 
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Mr.  Drew  Sand* 

NPRDC  Code  42 
Sen  Diego.  CA  92152-4(00 

Lowell  Scnoer 

PiKhotogicel  A  Quanuuuve 
Foundation* 

Coiiea*  of  Education 
Univenitv  of  Iowa 
Iowa  City.  IA  52242 

Dr  Maty  Scnrau 
905  Orchid  Way 
Cirtlbad.  CA  92009 

Dr.  Dan  Segall 

Navy  Personnel  RAD  Canter 

San  Diego.  CA  92152 

Dr  Rotan  Shealy 
Univemry  of  lUrnoia 
Department  of  Sutu tics 
101  lllmi  Hall 
725  South  Wnght  St. 
Champaign.  IL  41820 

Dr  Kazuo  Shigamasu 
7-9-24  Kuganuma-Kaipn 
Fujiuwa  251 
JAPAN 

Dr.  Richard  E.  Snow 
School  of  Education 
Sunford  Univeraity 
Stanford.  CA  9*305 

Dr.  Richard  C  Sortnacn 
Navy  Fanonndl  RAD  Center 
Sen  Diego.  CA  92152-4(00 

Dr.  Judv  Spray 
ACT 
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University  of  lllinou 
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Mr.  Brad  Sympaon 

Navy  Personnel  RAD  Center 

C ode  s; 

Sen  Diego,  CA  92132-4(00 

Dr.  John  Tsngney 
AFOSR.NL  Bldg  410 
Soiling  APB.  DC  20332-4441 

Dr.  Kikumi  Tauuoka 
Educational  Teatmg  Seme* 

Mad  Stop  00-T 
Pnnceton.  NJ  01541 

Dr.  Maunet  Tauuoka 
Education*  Teatmg  Service 
Mail  Stop  05-T 
Pnnceton.  NJ  0(541 

Dr  David  Tbween 
Department  of  Paycbologr 
University  of  Kane** 

Lawrence.  KS  44044 

Mr.  Thome*  J.  Thomas 
John*  Hopkins  University 
Department  of  Paychotogr 
Charla*  A  54th  Street 
Baltimore.  MD  212K 

Mr.  Gary  Tbomeeeon 
University  of  Mime 
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Champaign.  IL  4100 

Dr.  Robert  Tsutakaw* 

Umvetsiiy  of  Mieaoun 
Dapertmani  of  Suuetice 
222  Math.  Sacncm  Bldg 
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Dr.  Ledyard  Tucker 
University  of  Ulinoa 
Department  of  Payebok>0 
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Navy  Personnel  RAD  Center 
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Dr.  Howard  Warner 
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Pnnceton,  NJ  0(541 
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Boa  415 

Mihvaukae.  W1  53201 
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Educational  Tatung  Seme* 
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San  Diefo,  CA  41152-6100 


Or.  George  Woof 
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